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INTRODUCTION 


Background 


The  Target  Acquisition  and  Analysis  Training  System  (TAATS),  a  part  of  the 
research  program  at  the  Army  Research  Institute  (ARI)  Field  Unit,  Fort  Hood, 
was  designed  to  create  coherent  development  of  training  In  combat  vehicle 
recognition  and  Identification^.  A  series  of  research  and  development  products 
have  emerged  to  date  from  TAATS,  Including  the  Basic  Combat  Vehicle 
Identification  (CVI)  Training  Program  used  In  this  study. 

Previous  research  with  training  programs  In  the  CVI  series  has  Identified 
a  set  of  soldier  characteristics  which  appear  related  to  performance  with  CVI 
training  (Smith,  Heuckeroth,  Warnlck  &  Esslg,  1980;  Shope,  Smith,  Heuckeroth, 
Warnlck  &  Esslg,  1981;  Heuckeroth,  Shope  &  Smith,  1982).  One  of  the 

characteristics,  the  GT  score,  has  consistently  been  found  to  be  related  to 

performance;  soldiers  with  higher  GT  scores  perform  better  with  a  CVI  training 
program. 

It  was  hypothesized  that,  with  a  verbally  oriented  program  such  as  a  CVI 
training  program,  verbal  proficiency  might  be  more  directly  related  to 
performance  than  such  a  general  ability  measure  as  GT  score.  For  this  reason  a 

test  was  devised  for  this  research  which  had  as  Its  objective  the  direct 

measurement  of  verbal  ability  skills  needed  for  this  training  task. 

Moreover,  In  belief  that  environmental  variables  such  as  general  morale 
should  also  have  an  Impact  on  training,  an  assessment  of  morale  was  taken. 

Items  from  the  Commander's  Unit  Analysis  Profile  (CUAP)  (Palmer  et  al,  1984) 
were  chosen  which  appeared  to  have  face  validity  and  to  be  positively  related 
to  success  with  a  CVI  training  program. 

Military  Problem 

The  ability  to  recognize  and  Identify  vehicles  Is  a  skill  required  of  all 
soldiers.  The  unit  commander  Is  responsible  for  providing  training 
opportunities  to  soldiers  In  the  unit  which  develop  this  ability.  The  Basic 
CVI  Training  Program  Is  the  building  block.  However,  there  Is  great 
variability  among  soldiers  regarding  the  time  required  to  train  to  the  current 
standard.  Identification  of  methods  that  can  be  applied  which  will  decrease 
training  time,  particularly  for  less  proficient  soldiers  would,  therefore,  be 
of  value  to  the  unit  commander. 

Purpose  of  this  Research 

This  research  examines  GT,  VCR,  and  TRQ  measures  In  a  regression  model 
to  determine  their  relationship  to  performance  on  the  Basic  CVI  Training 

^Recognition  requires  the  soldier  to  discriminate  between  a  threat  or  friendly 
vehicle.  Identification  requires  the  soldier  to  give  the  name  or  number  of  the 
vehicle . 


Program.  The  outcome  provides  some  estimate  of  the  usefulness  of: 

(a)  training  related  to  Improving  the  military  vocabulary  needed  for  effective 
vehicle  Identification;  (b)  Identifying  aspects  of  unit  environment  which 
Impact  on  vehicle  Identification  performance. 
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METHOD 


Rationale 


In  this  research,  measures  believed  to  be  related  to  task-specific  verbal 
proficiency  and  general  morale,  as  well  as  GT  score,  were  examined  as 
correlates  of  performance  with  the  Basic  Combat  Vehicle  Identification  (CVI) 
Training  Program.  (A  complete  description  of  the  CVI  program  can  be  found  In 
GTA  17-2-9.)  An  objective  measure  of  task-specific  verbal  abilities  was  taken 
before  the  training  with  a  test  Instrument  designed  for  this  study.  An 
assessment  of  general  morale  was  obtained  by  selective  use  of  Items  from  a 
previously  developed  questionnaire,  the  Commander's  Unit  Analysis  Profile 
(CUAP)  (Palmer  et  al,  1984).  GT  scores  were  obtained  from  the  units'  records. 
Soldiers  were  trained  on  the  Basic  CVI  Training  Program  In  the  prescribed 
manner  after  being  pretested  on  their  existing  knowledge  of  the  vehicles 
Involved.  The  test  used  was  the  same  posttest  taken  at  the  completion  of 
training  to  assess  the  effectiveness  of  the  training.  The  dependent  measure 
used  for  evaluating  performance  was  the  number  of  correct  Identification 
responses  on  the  posttest. 

Soldier  Participants 

Data  were  collected  from  129  male  soldiers  provided  by  four  units  of  the 
193d  Infantry  Brigade  headquartered  at  Fort  Clayton,  Canal  Zone,  Republic  of 
Panama.  Soldiers  Included  In  the  research  were  chosen  at  the  discretion  of 
their  units.  The  mean  GT  score  was  104.3,  with  a  standard  deviation  of  16.3. 
The  modal  rank  was  pay  grade  E4,  with  a  range  from  pay  grades  El  to  E5.  Mean 
time  In  service  was  3.2  years,  with  a  range  from  0.3  years  to  11.2  years.  MOSs 
represented  covered  a  wide  range,  as  listed  In  Table  1.  This  group  is  referred 
to  hereafter  as  the  "first  sample." 

Data  from  another  group  of  soldiers  ("second  sample")  were  used  to  test 
the  reliability  of  model  predictions  derived  from  the  first  sample.  These 
soldiers  were  Involved  In  another  CVI  study  with  another  purpose.  Data  was 
obtained  from  114  soldiers  assigned  to  combat  arms  units  at  Fort  Hood,  Texas. 
The  mean  GT  score  wa^  100.4,  with  a  standard  deviation  of  14.9.  The  modal  rank 
was  pay  grade  E4,  with  a  range  from  pay  grades  El  to  E5.  MOSs  represented 
again  covered  a  varied  range. 

Measurement  Instruments 


Measures  of  the  soldiers'  ability  to  recognize  and  identify  the  30  test 
combat  vehicles  were  taken  before  and  after  the  training  through  administration 
of  the  Final  Test,  Module  7  of  the  Basic  CVI  Training  Program.  Measures  of 
task-specific  verbal  proficiency  were  taken  objectively  with  a  verbal 
recognition  task  (the  Verbal  Cue  Recognition  Test).  Readiness  to  train  was 
assessed  using  a  version  of  the  Commander's  Unit  Analysis  Profile  (CUAP)  which 
was  originally  designed  to  measure  general  morale  within  a  unit.  GT  scores 
were  obtained  from  unit  rosters. 
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CVI  Final  Test  (Module  7)  The  CVI  Final  Test  Module  contains  the  30 
different  vehicles  Included  In  the  6  training  modules.  The  60  slides  In  this 
module  represent  a  front  view  and  an  oblique  view  of  each  of  the  vehicles  In  a 
random  sequence.  Each  vehicle  was  to  be  recognized  as  "friend"  or  "threat"  and 
Identified  by  vehicle  name,  e.g.,  "Ml"  or  "Scimitar"  or  "ZSU-57-2."  Each  slide 
Is  exposed  for  8  seconds. 


Table  1 

MOS  Distribution 


MOS 

Frequency 

Percent 

05B 

5 

3.8 

05C 

3 

2.3 

05G 

1 

0.8 

IIB 

39 

30.2 

lie 

6 

4.6 

12B 

7 

5.4 

13B 

3 

2.3 

13E 

1 

0.8 

13F 

12 

9.3 

16P 

1 

0.8 

16S 

2 

1.6 

19E 

1 

0.8 

31M 

2 

1.6 

31V 

2 

1.6 

36K 

6 

4.6 

62E 

1 

0.8 

63B 

3 

2.3 

63S 

1 

0.8 

63Y 

4 

3.1 

64C 

4 

3.1 

71L 

3 

2.3 

72E 

2 

1.6 

75B 

1 

0.8 

76W 

1 

0.8 

76Y 

4 

3.1 

91B 

12 

9.3 

91C 

1 

0.8 

98C 

1 

0.8 

Totals 


129 


100.0 


Verbal  Cue  Recognition  Test  (VCR)  The  Verbal  Cue  Recognition  Test  was 
designed  for  this  study  to  objectively  measure  the  extent  soldiers  were  able  to 
understand  parts  of  vehicles  when  spoken.  The  parts  selected  were  significant 
cues  presented  In  the  CVI  Training  Program.  The  test  consisted  of  15  line 
drawings  of  15  different  armored  vehicles,  with  5  different  parts  numerically 
labeled  on  each.  Fifteen  part  names  were  verbally  presented  via  tape  recorder, 
one  for  each  vehicle,  and  soldiers  were  asked  to  mark  the  appropriate  part  on 
their  answer  sheets.  Through  this  measurement  some  understanding  of  the  verbal 
difficulties  causing  problems  for  soldiers  were  assessed. 

Training  Readiness  Questionnaire  (TRQ)  The  CUAP  questionnaire  Is  a 
unit-evaluation  tool  developed  by  the  US  Army  Research  Institute  (Palmer  et  al, 
1984).  It  was  designed  to  provide  commanders  of  company-size  units  a  means  of 
Identifying  current  troop  attitudes  that  may  detract  from  or  contribute  to 
overall  operational  effectiveness.  Reliability  and  validation  data  for  this 
edition  of  CUAP  were  collected  from  approximately  5,000  soldiers  stationed  In 
Forces  Command  and  US  Army  Europe.  The  questionnaire  was  designed  to  be 
administered  to  Els  through  E5s  and  contains  88  Items  with  5-polnt  response 
scales  which  can  be  administered  In  about  15  minutes.  The  CUAP  provides  the 
commander  an  estimate  of  the  unit's  standing  In  21  different  areas.  These 
areas  or  factors  Include  such  topics  as:  Unit  Cohesiveness;  Quality  of 
Training;  Officer,  NCO,  and  Immediate  Supervisor  Leadership;  Confidence  In 
Unit;  Alcohol/Drug-Related  Problems;  Race  Relations;  Job  Satisfaction; 

Promotion  Policy;  and  Morale  and  Reenllstment  Potential.  The  test/retest 
reliability,  based  upon  scores  of  Individual  respondents,  was  .78  (£  <  .001). 
Based  upon  unit  scores  (averages)  It  was  .90  (£  <  .001). 

This  research  utilized  elements  of  the  CUAP  primarily  because  the  Items  on 
their  face  suggest  they  might  tap  Individual  attitudes  which  may  be  correlated 
with  performance  In  a  clearly  defined  learning  situation.  Fourteen  CUAP  Items 
were  chosen  ultimately.  Note  that  the  initial  work  on  the  CUAP  did  not  seek 
learning  performance  correlates. 

Procedure 


First  Sample 

Soldiers  comprising  the  first  sample  (Panama)  were  trained  In  four  groups 
in  four  different  locations  throughout  Panama  corresponding  to  the  four  units 
from  which  they  were  drawn.  All  groups  were  met  with  every  day  for  a  week, 
Monday  through  Friday,  and  received  the  same  treatment,  essentially  a  Basic  CVI 
Training  Program.  The  soldiers  attended  class  each  day  for  about  an  hour  and  a 
half. 


Initial  data  collected  on  the  first  day  Included  a  pretest  to  measure  the 
extent  soldiers  already  had  some  knowledge  of  the  identification  of  armored 
vehicles;  this  pretest  was  the  Module  7  Final  Test  from  the  Basic  CVI  Training 
Program.  An  objective  measure  was  taken  to  assess  soldiers'  knowledge  of  the 
English  language  as  applied  to  the  part  description  of  armored  vehicles,  the 
Verbal  Cue  Recognition  Test  (VCR).  A  measure  of  general  morale  was  taken  with 
the  Training  Readiness  Questionnaire  (TRQ). 
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The  training  modules  of  the  Basic  CVI  Training  Program  were  administered 
on  Tuesday,  Wednesday,  and  Thursday.  The  six  training  modules.  Module  1 
through  Module  6,  were  administered  two  each  day. 

The  Module  7  Final  Test  was  administered  again  on  Friday  to  serve  as  a 
posttest  evaluating  the  effectiveness  of  training. 

Second  Sample 

The  second  sample  (Fort  Hood)  was  run  In  a  similar  manner,  with  a  Pretest 
on  Monday,  Tuesday  through  Thursday  training,  and  a  Friday  Posttest.  These 
data  were  acquired  from  another  study  run  for  another  purpose  and  were  used  to 
cross-valldate  the  findings  from  sample  one. 

Analysis 

The  dependent  variable  chosen  to  evaluate  performance  with  the  Basic  CVI 
Training  Program  was  the  Identification  response.  Previous  research  (Smith  et 
al,  1980;  Heuckeroth  et  al,  1981;  Shope  et  al,  1981)  demonstrated  that  It  Is  a 
reliable  measure,  whereas  the  recognition  response  provides  a  0.5  probability 
of  being  correct  when  soldiers  were  merely  guessing.  The  guessing  factor  with 
the  Identification  response  Is  nil. 

Reliability  of  the  VCR  and  TRQ  test  Instruments  was  established  using  data 
from  sample  one  In  a  split-half  Pearson  product-moment  correlation.  The 
relative  correlations  among  GT  score,  VCR  score,  and  TRQ  score  were  examined 
with  a  stepwise  multiple  regression  procedure  utilizing  both  backward  and 
forward  selection  of  variables  to  be  Included  In  the  model,  l.e.,  variables 
already  Included  In  the  model  can  be  removed  on  subsequent  steps  (Hocking, 
1976). 
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Verbal  Cue  Recognition  (VCR)  The  split-half  reliability  procedure  using 
Sample  One  was  used  to  estimate  the  reliability  of  the  Verbal  Cue  Recognition 
questionnaire.  Even  numbered  items  on  the  questionnaire  were  split  from  the 
odd  numbered  items,  each  set  of  responses  were  totaled  for  each  soldier,  then  a 
correlation  run  across  soldiers  for  an  estimate  of  the  Intercorrelation  between 
the  two  groups  of  items.  A  significant  correlation  was  obtained  between  the 
two  sets  of  items,  r_  (129)  =  .67,  £  <  .0001.  Using  the  Spearman-Brown  formula^ 
to  correct  the  reliability  estimate  for  test  length  produces  r^  =  .80. 

Training  Readiness  Questionaire  (TRQ)  A  similar  split-half  reliability 
procedure  utilizing  data  from  Sample  One  was  applied  to  odd  and  even  items  from 
the  Training  Readiness  Questionnaire.  When  the  totaled  scores  from  each  group 
were  correlated,  a  significant  correlation  was  also  produced,  £  (129)  =  .84, 

£<  .0001.  Again  using  the  Spearman-Brown  formula  the  corrected  reliability 
estimate  is  .91. 

Predictability 

GT  scores  were  introduced  into  a  regression  model  along  with  the  VCR  and 
the  TRQ  as  potential  predictors  of  identification  performance.  The  results  of 
this  analysis  produced  the  model  portrayed  in  Table  2.  The  VCR  score  was  the 
first  variable  to  enter  the  stepwise  regression,  with  GT  score  entered  in  the 
second  step,  and  the  TRQ  score  the  final  variable  to  enter  the  predictive 
model.  No  variables  were  backed  out  of  the  model. 

Observed  versus  Predicted  Correlations 

First  Sample  Predicted  values  for  each  soldier  using  TRQ,  GT,  and  VCR  were 
computed  beta  weights  for  the  model  presented  in  Table  2.  Using  the  weights 
derived  from  this  computation  (.21,  .41,  &  .80),  a  predicted  score  was  obtained 
for  each  soldier  by  multiplying  the  weights  by  the  TRQ,  GT  and  VCR  scores.  A 
correlation  was  then  run  between  the  predicted  scores  and  the  observed  score 
across  soldiers.  The  resultant  correlation  between  the  predicted  and  observed 
scores  was:  £  (129)  =  .55,  £  <  .001.  This  finding  Indicates  that  when  TRQ,  GT 
and  VCR  scores  were  weighted  and  summed  for  soldiers,  approximately  30%  of  the 
variability  of  predicted  scores  was  in  common  with  vehicle  identification 
performance  scores.  See  Appendix  A,  Tables  1  and  2  for  correlations,  means  and 
standard  deviations  for  all  variables. 


O 

^The  Spearman-Brown  formula  used  to  obtain  the  corrected  reliability  estimate  is 
r  *  2rQ  /  (lt_  ),  where  r„  =  corrected  estimate  and  r_  is  the  split-half 
reliability.  ° 


Second  sample  The  identical  model  was  used  to  generate  predicted  scores 
for  a  second  sample  for  model  validation.  When  a  correlation  was  run  between 
the  observed  scores  from  the  second  sample  and  predicted  scores  produced  by  the 
model  from  the  weights  estimated  from  the  first  sample,  a  significant 
relationship  was  found,  £  (114)  *  .34,  £  <  .0014.  Since  shrinkage  in  the 
multiple  correlation  was  expected  for  the  validation  sample,  the  appropriate 
test  for  significance  of  differences  between  correlations  for  the  two  samples 
is  a  one-tailed  Z  test.  Results  of  this  test  indicated  Z  =  2.03,  £  <.03.  This 
finding  raises  a  question  over  the  validity  of  the  model  developed  for 
predicting  Identification  performance  generally."^  See  Appendix  A,  Tables  3  and 
4  for  sample  correlations,  means  and  standard  deviations  for  all  variables. 

Table  2 

Regression  Analysis 

Weighted  Values  for  TRQ,  GT,  and  VCR  Derived  from  Sample  One 


F 

2 

Regression 

3 

842.50 

17.31 

.0001 

Error 

119 

48.68 

TOTAL 

122 

R2  =  .30 

Variable 

^  Value 

ss 

F 

£ 

Intercept 

-  24.01 

TRQ 

0.21 

274.91 

5.65 

.02 

GT 

0.41 

512.64 

10.53 

.002 

VCR 

0.80 

662.25 

13.60 

.003 

value  was  computed  by  the  formula:  I  Zj.  -  Z^.  | 

1  2 

See  McNemar,  Q.  Psychological  Statistics,  John  Wiley  and  Sons,  Inc.  1962,  pp. 
139-140.  For  one-tailed  tests,  I  Z  I  ^  1.65  is  significant  at  £  <  .05. 


-  3 


N2  -  3 


DISCUSSION 


The  model  showed  weakness  in  Its  prediction  In  the  validation  sample 
(sample  2)  when  compared  with  the  model  development  sample  (sample  1).  However, 
given  the  strength  of  the  VCR  variable  In  sample  1,  It  Is  useful  to  consider  It 
further.  Moreover,  It  Is  the  factor  most  easily  modified  In  the  unit  by  simply 
adding  a  brief  training  program.  The  lack  of  strength  In  the  TRQ  variable  Is 
consistent  with  the  expectation  that  attltudlnal  measures  are,  at  best,  subject 
to  extreme  variability.  In  this  case,  attempting  to  relate  attitudes  to  a 
specific  performance  measure  decreases  the  expectation  that  a  strong 
relationship  would  be  found.  More  research  Is  needed  to  determine  If  these 
variables  are  precursors  or  merely  correlates  of  CVI  performance . 
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CONCLUSIONS 


A  regression  model  was  developed  using  the  VCR  test,  IRQ,  and  GT  for  the 
first  sample.  Results  In  the  first  sample  Indicated  that  the  VCR  test,  TRQ  and 
GT  were  correlates  of  performance  with  the  Basic  CVI  Training  Program.  A 
cross-validation  of  the  model  using  the  second  sample  was  conducted  and  the 
regression  model  composed  of  the  VCR,  TRQ,  and  GT  showed  a  weakness  as  a 
predictor  with  the  validation  sample  used.  Further  work  Is  required  to  refine 
this  model. 
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APPENDIX  A 

Correlations,  Means  and  Standard  Deviations 
for  Both  Samples 
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Table  1 


Correlations  Coefficients  and  Probabilities  for  Sample  One 


GT 

TRQ 

VCR 

Observed 

-.102 

.466 

.434 

GT 

.29 

.0001 

.0001 

109 

123 

123 

-.009 

.198 

TRQ 

.924 

.034 

115 

115 

.452 

VCR 

.0001 

129 

Table  2 

Means  and  Standard  Deviations  for  Sample  One 


N 


GT 

123 

TRQ 

115 

VCR 

129 

Observed 

129 

X 

IE 

104.28 

16.39 

42.37 

5.63 

11.33 

3.23 

8.42 

8.22 

Table  3 


Correlation  Coefficients  and  Probabilities  for  Sample  Two 


GT 

TRQ 

VCR 

Observed 

.206 

.266 

.323 

GT 

.061 

.008 

.0002 

83 

99 

99 

.112 

.139 

TRQ 

.276 

.173 

97 

97 

VCR 


.521 

.0001 


Table  4 

Means  and  Standard  Deviations  for  Sample  Two 


N 


GT 

99 

TRQ 

97 

VCR 

113 

Observed 

113 

X 

98.65 

15.08 

45.60 

5.65 

13.75 

1.45 

29.18 

9.52 

